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Abstract 

Mathematical  modeling  and  computer  simulations  are  nowadays  widely  used  tools  to  predict  the  behavior 
of  problems  in  engineering  and  in  the  natural  and  social  sciences.  All  such  predictions  are  obtained  by  for¬ 
mulating  mathematical  models  and  then  using  computational  methods  to  solve  the  corresponding  problems. 
We  use  a  probability  theory  approach  for  uncertainty  quantification  (UQ)  since  it  is  particularly  well  suited 
for  SPDE  models,  and  focus  on  the  broad  research  areas  of  algorithmic  development  and  numerical  analysis 
for  the  discretization  of  systems  of  linear  or  nonlinear  SPDEs,  building  upon  and  significantly  extending  our 
previous  successful  work. 

We  conduct  comprehensive  theoretical  and  computational  comparison  of  the  efficiency,  accuracy,  and  range 
of  applicability  of  non-intrusive  methods,  such  as  stochastic  collocation  methods,  and  intrusive  techniques, 
such  as  stochastic  Galerkin  methods,  for  solving  SPDEs  and  for  UQ  applications. 

We  extend  the  algorithmic  and  analysis  advances  wrought  by  these  efforts  to  the  even  more  challenging 
settings  of  optimal  control  and  parameter  identification  problems  for  SPDEs.  The  parameter  identification 
problem  is  especially  important  in  the  SPDE  setting  since  it  provides  a  very  useful  mechanism  for  deter¬ 
mining  statistical  information  about  the  input  parameters  from,  e.g.,  measurements  of  output  quantities. 
This  effort  builds  on  our  previous  work  on  adjoint  and  sensitivity-based  methods  for  deterministic  optimal 
control  and  parameter  identification  problems  to  develop  similar  methods  for  tracking  statistical  quantities  of 
interest  from  the  computational  solutions  of  linear  and  nonlinear  SPDEs  driven  by  high-dimensional  random 
inputs. 

Status /Progress 

1.  A  generalized  methodology  for  the  solution  of  stochastic  identification  problems  constrained 
by  partial  differential  equations  with  random  input  data  [5] 

We  propose  and  analyze  a  scalable,  parallel  mechanism  for  stochastic  identification/control  for  problems 
constrained  by  partial  differential  equations  with  random  input  data.  Several  identification  objectives  are 
discussed  that  either  minimize  the  expectation  of  a  tracking  cost  functional  or  minimize  the  difference  of 
desired  statistical  quantities  in  the  appropriate  Lp  norm,  and  the  distributed  parameters/control  can  both 
deterministic  or  stochastic.  Given  an  objective  we  prove  the  existence  of  an  optimal  solution,  establish 
the  validity  of  the  Lagrange  multiplier  rule  and  obtain  a  stochastic  optimality  system  of  equations.  The 
modeling  process  may  describe  the  solution  in  terms  of  high  dimensional  spaces,  particularly  in  the  case 
when  the  input  data  (coefficients,  forcing  terms,  boundary  conditions,  geometry,  etc)  are  affected  by  a 
large  amount  of  uncertainty.  For  higher  accuracy,  the  computer  simulation  must  increase  the  number 
of  random  variables  (dimensions),  and  expend  more  effort  approximating  the  quantity  of  interest  in 
each  individual  dimension.  Hence,  we  introduce  a  novel  stochastic  parameter  identification  algorithm 
that  integrates  an  adjoint-based  deterministic  algorithm  with  the  sparse  grid  stochastic  collocation  FEM 


approach.  This  allows  for  decoupled,  moderately  high  dimensional,  parameterized  computations  of  the 
stochastic  optimality  system,  where  at  each  collocation  point,  deterministic  analysis  and  techniques  can 
be  utilized.  The  advantage  of  our  approach  is  that  it  allows  for  the  optimal  identification  of  statistical 
moments  (mean  value,  variance,  covariance,  etc.)  or  even  the  whole  probability  distribution  of  the  input 
random  fields,  given  the  probability  distribution  of  some  responses  of  the  system  (quantities  of  physical 
interest).  Our  rigorously  derived  error  estimates,  for  the  fully  discrete  problems,  will  be  described  and 
used  to  compare  the  efficiency  of  the  method  with  several  other  techniques.  Numerical  examples  illustrate 
the  theoretical  results  and  demonstrate  the  distinctions  between  the  various  stochastic  identification 
objectives. 

The  general  framework  of  the  problem  is  the  following:  we  seek  random  parameters,  coefficients  k(lu.  x) 
and/or  forcing  terms  f(u>,  x),  with  x  £  D  C  ui  £  SI,  where  (f2,  T ',  P)  a  complete  probability  space,  that 
minimize  the  mismatch  between  stochastic  measured  and  simulated  data.  Here  f l  is  the  set  of  outcomes, 
T  C  2n  is  the  cr-algebra  of  events  and  P  :  T  — >  [0, 1]  is  a  probability  measure.  There  are  two  main  ways 
of  measuring  this  spatial-stochastic  quantity:  the  expected  value  of  spatial  mismatch  (see  e.g.  [8,  7]  more 
ref’s)  and  the  spatial  mismatch  of  averages  of  the  statistical  quantities  of  interest.  More  precisely,  we 
consider  the  minimization  cost  functionals  of  the  type 

J{U,  («,/))  (0.1) 

over  all  K,f  and  random  solutions  u  :  SI  x  D  — >  R.  that  satisfy  P-almost  everywhere  in  f l,  or  in  other 
words  almost  surely  (a.s.),  the  following  stochastic  boundary  value  problem: 

C(k)(u)  =  /  in  D  (0-2) 

supplemented  with  appropriate  boundary  conditions. 

We  consider  the  groundwater  flow  problem  in  a  region  D  C  Rd,  d  =  1,2,3,  where  the  flux  is  related  to 
the  hydraulic  head  gradient  by  Darcy’s  law.  We  model  the  uncertainties  in  the  soil  by  describing  the 
conductivity  coefficient  k  as  a  random  field  denoted  k(ui,  x).  Similarly,  the  stochastic  forcing  term  f(u>,  x) 
models  the  uncertainty  in  the  sources  and  sinks. Therefore  the  hydraulic  head  u  :  SI  x  D  is  also  a  random 
field  satisfying  the  elliptic  stochastic  partial  differential  equation  (SPDE): 

(  -V  •  (k(uj,  x)Vii(w,  a;))  =  /(w,  x)  in  SI  x  D , 
u  =  0  on  Si  x  dD. 

The  linear  elliptic  SPDE  (0.3)  with  n(u>,  •)  uniformly  bounded  and  coercive,  i.e. 

there  exists  Kmin ,  nmax  £  (0,  +oo)  such  that  P(w  £  SI  :  k(u,  x)  £  Umax]  Va:  £  D)  =  1  (0.4) 

and  f{u>,  •)  square  integrable  with  respect  to  P,  satisfies  assumptions  A1  and  A2  with  W(D)  =  Hq{D). 
We  shall  assume  that  D  is  a  bounded  and  open  subset  of  Rd,  either  with  smooth  boundary  (of  class  C 2  for 
instance)  or  convex.  This  implies  that  for  every  /  £  L2P(Sl',  L2 (D)) ,  problem  (0.3)  has  a  unique  solution 
u  £  Lp(S2;  Hq(D)  n  H2{D)).  The  solution  to  (0.3)  must  be  understood  in  a  variational  sense,  i.e.,  for¬ 
given  /  £  Lp(Q,L2(D))  we  say  that  u  £  Lp(Sl,  Hq  (D))  is  a  solution  of 


E 


n(-,x)dXiu(-,x)dXiz(x)  -  f{-,x)z{x)dx 


=  0, 


Vz  g  Hl(D). 


(0.5) 


To  simplify  the  presentation,  we  use  operator  C  to  represent  the  Poisson  operator  introduce  in  forward 
state  equation  (0.3).  Here  we  need  to  introduce  all  the  admissible  sets  to  simplify  the  notation  going 
forward.  First  we  define  the  admissible  set  of  conductivity  coefficients  given  by 


Aad  =  {k  £  L°° (fi;  L°° (D))  |  k(u>,x)  satisfies  (0.4)}  , 


(0.6) 


(0.7) 


then  given  k  £  Aad  let  the  admissible  set  of  states  and  controls  be  defined  as 

Bad  =  {(«,/)  |  U  £  L%(n-H^D)  n  H2(D))  and  /  e  L2P{Cl-  L2(D))}  . 

Finally,  given  /  £  L2p(Cl]  L2(D))  let  the  the  admissible  set  of  states  and  coefficients  be  described  as 

Cad  =  {(«,  k)  I  lie  L2p(Q;  Hl{D)  n  H2{D))  and  k  €  Aad}  ■  (0.8) 

We  also  introduce  a  stochastic  target  function  u  £  L2P(Cl\  L2(D)),  a  given  possible  perturbed  observation. 
We  consider  a  general  class  of  minimization  problems  for  solving  the  stochastic  inverse  problem  for  the 
random  forcing  function  f(uj,x )  and  the  solution  u(u>,x)  satisfying  a.s.  (0.3).  Here  we  assume  given  the 
input  random  process  k  £  Aad  and  the  target  u  £  Lp(Cl;  L2 (D))  and  we  want  to  recover  (u*j,fj)  such 
that 


«>/})  =  jnf  U(u,f)  ■  subject  to  (0.3)}  (0.9) 

where  J(u,f)  is  a  given  stochastic  functional  constructed  to  track  the  desired  random  fields  or  the  sta¬ 
tistical  quantities  of  interest  (Qol)  of  such  stochastic  functions.  This  leads  to  the  following  definition.  A 
pair  (ztj,  fj)  £  Bad  satisfying  (0.3)  a.s.,  for  which  the  infimum  in  (0.9)  is  attained  are  called  the  stochastic 
optimal  pair  and  the  control  /  is  referred  as  stochastic  optimal  control.  In  what  follows  we  will  describe 
two  functionals,  denoted  Ji(u,  /)  and  foiu,  /)  used  to  solve  stochastic  optimal  control  problems.  The 
first,  described  by  (0.10),  is  based  on  the  standard  classical  approach  based  on  stochastic  least  squares 
approximation  whereas  the  second,  described  by  (0.14),  uses  statistical  tracking  objectives  and  is  easily 
generalized.  We  will  also  describe  the  corresponding  adjoint  equations,  optimality  conditions  and  state 
the  necessary  conditions  for  existence  and  uniqueness  of  the  stochastic  optimal  pair. 

The  optimal  control  problem  using  stochastic  least  squares  minimization 

For  k  £  Aad  given  data,  we  consider  the  following  optimal  control  problem  associated  with  a  stochastic 

elliptic  boundary  value  problem: 


Minimize  the  cost  functional 


(P.l)  {Ji{u,f)=  E 


J|Ko;,.)-«(a;,-)||i2(D)  +  f||/(^-)ll!^) 


(0.10) 


on  all  (u,  f)  £  Bad  subject  to  the  stochastic  state  equations  (0.3). 


Using  standard  techniques  (see  e.g.  [13,  14,  1,  2,  15,  10,  9,  7])  one  can  prove  that  the  problem  (0.10)-(0.3) 
has  a  unique  optimal  pair  that  is  characterized  by  a  maximum  principle  type  result. 

(u,  f)  is  the  unique  optimal  pair  in  problem  (0.10)-(0.3)  if  and  only  if  there  exists  £  £  L2p(Cl]  Hq(D))  such 
that 


and 


— V  •  (k(u),  x)V£(cj,  x ))  =  u(lo,  x) 

£(u),x)  =0 


u(u>,  x)  a.e.  in  Cl  x  D, 
a.e.  in  Cl  x  dD. 


/(w,x) 


- £(w,:r) 

a 


a.e.  in  x  D. 


(0.11) 


(0.12) 


Therefore  the  solution  of  the  control  problem  is  the  solution  of  the  optimality  system: 


(the  state  equations) 

(the  adjoint  equations) 

(and  the  optimality  condition) 


— V  •  (kVm) 
-V  •  (kVO 

7 


=  7 


=  u  —  u 


in  Cl  x  D,  and  u  =  0  in  Cl  x  dD ; 

in  Cl  x  D}  and  £  =  0  in  U  x  dD. 

a.e.  in  Cl  x  D. 


(0.13) 


The  necessary  and  sufficient  conditions  (0.13)  are  a  system  of  coupled  stochastic  partial  differential  equa¬ 
tions  whose  solution  yields  the  optimal  control  /,  the  optimal  state  u  and  the  optimal  adjoint  state 

e 

The  optimal  control  problem  utilizing  statistical  tracking  objectives 

Now  we  aim  at  matching  expected  values,  i.e.,  we  consider  the  following  problem: 


Minimize  the  cost  functional 

(P.2)  <  J2(u,/)  =  ^  J  [Eu(-,x)  -  Eu(-,x)]2dx  +  ^  j  Ef2(-,x)dx7 

on  all  (u,  f)  £  Bad  subject  to  the  stochastic  state  equations  (0.3). 


(0.14) 


Note  that 

J f  [Eu(-,x)  -  Eu(-,x)Ydx  <  e(||w-u||^2(d)), 
which  justifies  the  functional  (0.14). 

( u ,  /)  is  the  optimal  pair  in  problem  (0.10), (0.3)  if  and  only  if  there  exists  £  £  L2P(td;  Hq(D))  such  that 
— V  •  :r)V£(w,  x))  =E  (u(- ,  x)  —  u(- ,  x))  inflxD, 

(0.15 

f(co,x)  =0  inflxdD. 


and 


f(u>,  x)  = - £(lu,x)  a.e.  inflxD.  (0.16) 

a 

Therefore  the  solutions  of  the  control  problem  are  the  solutions  of  the  optimality  system: 


(the  state  equations) 

—V  •  (kVu) 

=  / 

in  f!  x  fi, 

and  u  =  0  in  Q  x  dD , 

(the  adjoint  equations) 

-V  •  (kV£) 

=  E(u  —  u) 

in  fl  x  D, 

and  £  =  0  in  fl  x  dD7 

(and  the  optimality  condition) 

/ 

=  -^ 

a.e.  in  fl  x  D. 

(0.17) 

The  conditions  (0.17)  resemble  the  optimality  system  (0.13),  the  difference  is  only  in  the  adjoint  equation 
which  has  a  deterministic  right-hand  side.  Nevertheless,  the  adjoint  variable  is  still  a  stochastic  quantity, 
the  adjoint  operator  having  stochastic  coefficients. 

Stochastic  parameter  identification  problems 

We  also  study  the  identification  of  the  coefficient  k  in  the  stochastic  boundary  value  problem  (0.3).  In 
the  deterministic  case,  the  direct  problem,  where  n  is  given,  the  existence  and  uniqueness  results  are  well 
known,  see  e.g.  [11].  The  linear  deterministic  inverse  problem  related  to  (0.3)  has  been  studied  in  e.g. 
[1],  for  the  nonlinear  deterministic  see  e.g.  [3]. 

For  the  identification  problem,  we  are  given  a  possible  perturbed  observation  u  corresponding  to  the  state 
variable  u  and  we  must  determine  k  in  (0.3)  such  that  u(k)  =u'mflxD.  Of  course,  such  an  k  may  not 
exist. 

Parameter  identification  using  stochastic  least  squares  minimization 


The  least  squares  approach  leads  us  to  the  minimization  problem: 


Minimize  the  cost  functional 


(P.3)  Jz{u,  k)  =  E 


2  HM  —  u\\l2(D)  +  ^IIkIIl2(d) 


(0.18) 


on  all  ( u,k )  £  Cad  subject  to  the  stochastic  state  equations  (0.3). 

Let  (u*,k*)  be  an  optimal  pair  in  problem  (0.3)  and  (0.18).  Then 

k*(u>,  x)  =  max{Kmin,  min{  —  X7u*(u>,  x)Vr)(u>,  x),  Kmax}}  a.e.  in  Cl  x  D  (0.19) 


where  rj  £  L2P{Cl\ Hq(D))  is  the  solution  of 


—’V-(K*(w,x)'Vr)(L!,xy)  =  u*(u,  x)  —  u(ui,  x)  in  Cl  x  D , 

rj(oj,x)  =0  in  Cl  x  dD. 


(0.20) 


Parameter  identification  utilizing  statistical  tracking  objectives 

For  the  identification  problem  matching  expected  values,  given  a  possible  perturbed  observation  u  corre¬ 
sponding  to  the  state  variable  u,  we  seek  n  in  (0.3)  such  that  Eu(k)  =  Eu  in  D.  Therefore  we  consider 
the  problem: 


(P.4) 


Minimize  the  cost  functional 

Ji(u,K)  =  —  I  [Em(-, x)  —  Em(-, a;)] 2 dx  +  I  E n2(-,x)dx, 

2  Jd  2  JD 


(0.21) 


on  all  ( u,k )  £  Cad  subject  to  the  stochastic  state  equations  (0.3). 
Let  (u,  k)  be  an  optimal  pair  in  problem  (0.3)  and  (0.21).  Then 

k(u>,  x)  =  max{Kmin,  min{  —  Vw(w,  x)Vr](uj,  x),  «;max}}  a.e.  in  Cl  x  D 

where  rj  £  L2p{Cl\  Hq(D))  is  the  solution  of 

— V  •  x)Wr]{uj,  x))  =E (u(- ,  x)  —  u(- ,  x))  in  Cl  x  D , 

t)(uj,x)  =0  inClxdD. 


(0.22) 


(0.23) 


Identification  of  higher  order  moments 

If  one  is  interested  in  matching  covariance,  and/or  higher  order  moments,  the  cost  functional  used  in 
problem  (0.21)  can  be  generalized  as  follows.  Assume  we  are  interested  in  /border  moments,  and  /  £ 
Lp(Cl\L2C~2{D))  then 


Minimize  the  cost  functional 


(P.5) 


k)  =  —  f  [E?/(-,  x)  —  Et/(-,  x)]  ~ dx  +  ^  f  E K2(-,x)dx, 

o,  2/  JD  2  JD 


(0.24) 


,  on  all  ( u,k )  £  Cad  subject  to  the  stochastic  state  equations  (0.3). 


Let  (u,k)  be  an  optimal  pair  in  problem  (0.3)  and  (0.24).  Then 


k(u>,  x)  =  max{/tmin,  min{  —  Vu(w,  x)Vrj(u>,  x),  Kmax}}  a.e.  in  fl  x  D 

H 


(0.25) 


where  r/  £  Lp(fl;  Hq(D)  n  L2C(D))  is  the  solution  of 


— V  •  (k(u>,  x)  Vr](u!,  x))  ='^^/ke  1E(m^(-,  a;)  —  ue  (•,  a;))  infix  D, 


(0.26) 


i)(u),  x)  =0 


in  fl  x  dD. 


We  illustrate  the  convergence  of  the  generalized  stochastic  collocation  (gSC) ,  for  identifying  the  random 
process  n{u>,x)  coming  from  the  solution  of  the  stochastic  linear  elliptic  problem  described  in  0.3,  in  one 
spatial  dimension.  We  will  exemplify  the  algorithm  using  both  the  expected  value  of  spatial  mismatch 
and  the  spatial  mismatch  of  averages  of  the  statistical  quantities  of  interest.  The  rates  of  convergence  are 
derived  from  estimates  of  the  forward  problem  and  the  computational  results  are  in  accordance  with  the 
convergence  rates  predicted  by  the  theory.  However,  for  matching  the  expected  value  of  the  parameter 
and  the  state,  we  observe  faster  convergence  when  employing  the  statistical  tracking  objective  than  the 
standard  stochastic  least  squares  minimization,  which  suggests  the  inclusion  of  higher  order  moments  to 
the  tracking  functionals  may  result  in  even  better  statistical  description  of  random  fields. 

Finally,  we  will  also  use  this  problem  to  compare  the  convergence  of  the  gSC  approach  with  Monte  Carlo 
methods  for  solving  the  stochastic  optimality  system  resulting  from  the  stochastic  parameter  identification 
approach,  see  Table  0.1.  Given  a  stochastic  target  u{uj,x)  and  random  process  f(ui,x)  the  problem  is  to 
identify  the  optimal  coefficient  Kj(ui,  x)  and  state  Uj(u,  x)  satisfying 

J(uj,K*j)=  inf  J(u,k),  (0.27) 

(tl,K)eCad 


subject  to 


(  -V'(/t(w,  jVu(w,  ■))  =  /fyv)  infix  D, 

\  u[io,  j  =  0  on  fl  x  dD, 


(0.28) 


with  D  =  [0,1].  For  this  example  we  will  consider  both  identification  problems  by  letting  J  =  J3  and 
J  =  J4  described  by  equations  (0.18)  and  (0.21).  For  both  optimization  problems  we  assume  we  are  given 
the  exact  stochastic  target,  described  as 


u(u>,  x)  =  x(l  -  x2)  +  ^2  sin  ( Yn(w),  (0.29) 

n— 1  '  u  ' 

and  we  want  the  desired  optimal  (true)  random  coefficient  k  to  be  given  by 

k(u,  x)  =  (1  +  x3)  +  ^  cos  f  J  Yn(ui).  (0.30) 

The  goal  of  computation  will  be  to  find  the  optimal  (re}3,u}3)  and  (nj4,ujj  that  satisfy  (0.27)  -  (0.28) 
with  a  given  fixed  stochastic  load  defined  as  the  exact  right-hand,  i.e., 

f(u>,  x)  =  —V  •  (k(u>,x)\7u(uj,x)).  (0.31) 

For  x  £  D  we  let  Lu  =  2N  and  LK  =  1/2  and  we  note  that  both  random  expressions  for  u  and  7t  are  related 
to  a  truncated  Karhunen-Loeve  expansion  of  a  one-dimensional  stationary  covariance.  However,  this  is 
just  a  test  problem  where  we  have  guaranteed  well-posedness  through  the  construction  of  an  uniformly 


bounded  and  coercive  k(u>,  x)  and  enforced  isotropy  when  assembling  the  random  target  u,  the  stochastic 
process  k(w,x)  to  be  identified  and  forcing  function  /( oj,x)  with  respect  to  the  random  domain  In 
this  example,  all  the  random  variables  {Yn(uj)} are  independent,  have  zero  mean  and  unit  variance, 
i.e.  E[yn]  =  0  and  E[Y„Ym]  =  Snm  for  n,m  £  N+,  and  are  uniformly  distributed  in  the  interval  [0,1]. 

We  combine  the  gSC  approximations  with  an  gradient-based  optimization  method,  for  solving  (0.27)  - 
(0.28).  First,  we  plot  several  ensembles,  sampled  from  the  Clenshaw-Curtis  sparse  grid  Jf( 3,5),  of  the 
target  u(Y(cvk),  x),  the  the  exact  input  parameter  k(Y (u>k) , x)  and  the  right-hand  side  f(Y(u>k),x),  for 
k  =  1, . . . ,  M  =  241,  and  the  corresponding  expected  values  E  [u]  (®),  E  [k]  ( x )  and  E  [/]  (x)  in  Figures 
0.1(a),  0.1(b)  and  0.1(c)  respectively.  The  finite  element  space  for  the  spatial  discretization  is  the  span  of 
continuous  functions  that  are  piecewise  polynomials  with  degree  two  over  a  uniform  partition  of  D  with 
1225  unknowns. 


(a)  (b) 


Realizations  of  /(w*.,  •)  and  the  mean  E[f](x) 


0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1 


(c) 


Fig.  0.1:  For  a  finite  dimensional  probability  space  TN ,  with  N  =  5  we  plot  /c  =  l,...,M  =  241  realizations  (blue),  correspond¬ 
ing  to  Clenshaw-Curtis  samples  from  the  isotropic  sparse  grid  J4?( 3,5),  and  the  exact  expectation  (red)  of:  (1)  the  stochastic 
target  u(co,x),  (2)  the  true  input  parameter  k(u j,x)  and  (3)  the  forcing  function  f(uj,x). 


Instead  of  solving  the  optimality  systems,  a  gradient  algorithm  is  used  to  design  the  optimal  stochastic 
coefficient  k,j3(cj,x)  and  ac}4(o;,x)  respectively.  The  first  step  involves  computing  the  gradient  of  the  cost 


functionals  ^^(it,  k)  and  k).  In  this  example  the  gradient  of  the  cost  functionals  are  evaluated 

and  used  in  simple  minimization  framework  to  estimate  the  optimal  input  parameter  k(uj,x).  Given  the 
stochastic  load  /  and  the  target  u,  this  procedure  is  described  below. 

1.  Define  the  number  of  desired  sparse  grid  collocation  points  M  in  with  the  corresponding  inter¬ 
polating  basis  functions  {b/’fc(y)}^L1  of  VP(VN). 

2.  Set  the  gradient  iteration  count  i  =  0  and  select  an  initial  guess  for  the  input  coefficient  K^°^(y,x). 
Set  the  initial  step  size  e  <  1  used  by  the  gradient  algorithm. 

3.  Solve  the  forward  problem  given  by  (0.28)  using  «(*)  and  construct  the  corresponding  random  solution 

«Uw- 


4. 

5. 

6. 


Compute  the  cost  functionals  J„  \  where  n  =  3,4  when  solving  problems  (P.3)  or  (P.4)  respectively. 
Compute  the  gradient  of  the  cost  functionals  j^Jn  where  n  =  3,4. 

Compute  an  updated  random  coefficient  =  kM  —  e4-Jn\  check  the  convergence  criteria  and 

update  the  gradient  step  (if  necessary): 

For  our  particular  problem  described  by  (0.27)  -  (0.28)  we  define  the  penalty  term  f3  =  10”6  for  both 
functionals  J3  and  J4  described  by  (0.18)  and  (0.21)  respectively.  The  remaining  parameters  required  by 
the  gradient  algorithm  are  defined  as:  the  initial  step  size  e  =  10~3,  the  convergence  tolerance  tol  =  /3 
and  the  maximum  number  of  gradient  iterations  itermax  =  103. 

The  first  exhibition  of  the  improvements  offered  by  utilizing  out  proposed  functional  J4  as  opposed  to  J3 
for  constructing  the  optimal  pair  (u* ,  n*)  can  be  observed  in  Figure  0.2. 


Convergence  of  the  cost  functionals 


Fig.  0.2:  A  TV  =  11  dimensional  comparison  of  the  convergence  of  cost  functionals  J3  and  J4,  given  by  (0.18)  and  (0.21) 
respectively,  when  using  the  gradient-based  sparse  grid  stochastic  collocation  method  for  solving  the  optimization  problem 
(0.27)  -  (0.28)  with  /3  =  1CT6. 


2.  Improved  accuracy  in  regularization  models  of  incompressible  flow  via  adaptive  nonlinear 
filtering  [4] 

We  study  adaptive  nonlinear  filtering  in  the  Leray  regularization  model  for  incompressible,  viscous  Newto¬ 
nian  flow.  The  filtering  radius  is  locally  adjusted  so  that  resolved  flow  regions  and  coherent  flow  structures 
are  not  ‘filtered-out’,  which  is  a  common  problem  with  these  types  of  models.  A  numerical  method  is 
proposed  that  is  unconditionally  stable  with  respect  to  timestep,  and  decouples  the  problem  so  that  the 
filtering  becomes  linear  at  each  timestep  and  is  decoupled  from  the  system.  Several  numerical  examples 
are  given  that  demonstrate  the  effectiveness  of  the  method. 


(a) 


(b) 


Fig.  0.3:  A  N  =  1  dimensional  comparison  of  the  gradient-based  sparse  grid  stochastic  collocation  method,  with  M  =  5 
collocation  points,  for  solving  the  optimization  problem  (0.27)  -  (0.28)  with  functionals  J  =  J3  (dashed  black)  and  J  =  J4 
(solid  black).  We  plot:  0.3(a)  the  exact  first  moment  of  the  target  E[it]  (red)  versus  the  expected  value  of  the  optimal  solution 
E[itj3]  (dashed  black)  and  E [wj4]  (solid  black);  0.3(b)  the  exact  first  moment  of  the  coefficient  E[«]  (red)  versus  the  expected 
value  of  the  optimal  coefficients  E[kj3]  (dashed  black)  and  E[kjJ  (solid  black). 


(a) 


(b) 


Fig.  0.4:  A  N  =  5  dimensional  comparison  of  a  gradient-based  sparse  grid  stochastic  collocation  method,  with  M  =  61- 
collocation  points  ,  for  solving  the  optimization  problem  (0.27)  -  (0.28)  with  functionals  J  =  J3  (dashed  black)  and  J  =  J4 
(solid  black).  We  plot:  0.5(a)  the  exact  first  moment  of  the  target  K[u]  (red)  versus  the  expected  value  of  the  optimal  solutions 
E[i£j3]  (dashed  black)  and  E [wj4]  (solid  black);  0.5(b)  the  exact  first  moment  of  the  coefficient  E[7c]  (red)  versus  the  expected 
value  of  the  optimal  coefficients  E[kj3]  (dashed  black)  and  E[kjJ  (solid  black). 


3.  Analysis  of  stability  and  errors  of  IMEX  methods  for  magnetohydrodynamics  flows  at  small 
Reynolds  number  [12] 

The  MHD  flows  are  governed  by  the  Navier-Stokes  equations  coupled  with  the  Maxwell  equations  through 


(a) 


(b) 


Fig.  0.5:  A  N  =  11  dimensional  comparison  of  a  gradient-based  sparse  grid  stochastic  collocation  (SC)  method,  using  M  =  265 
collocation  points  with  a  gradient-based  Monte  Carlo  (MC)  method  using  1.2  x  106  samples,  for  solving  the  optimization 
problem  (0.27)  -  (0.28).  We  plot:  0.5(a)  the  exact  first  moment  of  the  target  E[u]  (red)  versus  the  expected  value  of  the  optimal 
solution  E[uj3]  using  SC  (dashed  black),  E [uj^\  using  SC  (solid  black)  as  well  as  E[uj4]  using  MC  (dotted  blue);  0.5(b)  the 
exact  first  moment  of  the  coefficient  E[7c]  (red)  versus  the  expected  value  of  the  optimal  coefficient  E[kj3]  using  SC  (dashed 
black),  E[«j  ]  using  SC  (solid  black)  as  well  as  E[kj4]  using  MC  (dotted  blue). 


N 

SG 

MC 

5 

61 

7e+03 

11 

1581 

9e+06 

21 

13329 

8e+09 

Table  0.1:  For  FN ,  with  N  =  5, 11  and  21,  we  compare  the  number  of  deterministic  solutions  required  by  the  sparse  grid  method 
(SG)  using  Clenshaw-Curtis  abscissas  and  the  Monte  Carlo  (MC)  method  using  random  abscissas,  to  reduce  the  original  error 
in  both  ||e[uj4]  —  E[u]||  ^  and  ||e[kj4]  —  E[re]||  ^  by  a  factor  of  104. 


coupling  terms.  The  physical  processes  of  fluid  flows  and  electricity  and  magnetism  are  quite  different 
and  non- model  problems  can  require  different  meshes,  time  steps  and  methods.  We  introduce  a  implicit- 
explicit  (IMEX)  method  where  the  MHD  equations  can  be  evolved  in  time  by  calls  to  the  NSE  and 
Maxwell  codes,  each  possibly  optimized  for  the  subproblem’s  respective  physics. 
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